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The rank sum test for outliers advanced by W. J. Youden provides a method for detecting if the 
measurement distribution of any one of a group of objects has a mean significantly different from 
the rest. This paper discusses a more general application of the rank sum procedure which permits 
a similar test on other parameters, such as the variance, with the same tables. Tables of the critical 
values of the extreme rank sum and the corresponding significance levels for one-sided tests are given 
in this paper to supplement similar tables for two-sided tests already published. 



Introduction 

W. J. Youden advanced in [l] 1 a nonparametric 
rank sum procedure for detecting whether the dis- 
tribution of measurements of any one of the rows of a 
two-way table of measurements had a mean that was 
noticeably different from the means of the other rows. 
In Youden's paper approximate 5 percent points for a 
two-sided test were given. Because of the discrete 
distribution of the rank sum statistic exact 5 percent 
points ordinarily do not exist. This technique was 
further investigated in [2], and there the tables were 
extended to include approximate 3 percent and 1 per- 
cent points along with the actual values of the 
significance levels. 

In all the writings and applications so far, this test 
has been used to detect an object (or laboratory) whose 
measurement distribution differs from the distribution 
of the other objects in its mean or median. However, 
the test, with the same tables, can often be used to 
detect an object whose distribution is different with 
respect to another parameter, for instance, the variance. 
The purpose of this note is to point out and illustrate 
the scope of possible applications of Youden's rank 
sum test, and to give a table of critical regions and 
significance levels for one-sided tests. 



1 . The Ordinary and the General 
Application 

The ordinary application of Youden's test as dis- 
cussed in fl] and [2] is as follows: Suppose there are / 
objects and ./judges. Each judge independently ranks 
the / objects according to some property. Thus, each 
object receives a rank, an integer between 1 and /, 
from each judge, and the ,/ ranks for each object are 
summed. Then if any object has a rank sum that is 
extremely high (or low) it can be concluded that the 
ranks were not assigned just by chance but that the 
objects tends to rank higher (or lower) than the rest. 

1 Figures in brackets indicate the literature references at the end of this paper. 

* University of Maryland, College Park, Md.;part time at the National Bureau of Standards. 



In many cases the rankings are assigned on the basis 
of measurements. That is, there is a measurement for 
each object-judge combination, and, for a given judge, 
the object with the highest measurement gets a rank of 
1, the object with the next highest gets a rank of 2, 
etc. (The ranks can be assigned in the reverse order 
if that is more convenient.) Then if an object gets an 
extreme rank sum it can be concluded that its measure- 
ments tend to be high or low accordingly. This appli- 
cation is actually a test on the means or medians of the 
measurement distributions for the different objects. 

The general application of this technique provides a 
test on other parameters, and it can be described in the 
following way. Suppose we have a two-way classifi- 
cation (Ixj) with Kij observations in cell (i, j). The 
range of the subscripts i andy will be 1, 2, . . . , /, and 
1, 2, . . . , ,/ respectively throughout the paper. Let 
the rows correspond to objects being judged and the 
columns correspond to judges. Now fix attention on 
the yth column. Suppose the Ky measurements for 
row i are each distributed with a probability density 
function, fjixt; 6j(i)), which depends on a row parameter 
Oj that has the value 6j{i) for the ith row. Note that 
each column may have its own distribution,/}, and its 
own set of row parameters 6,(i). 

We wish to test the hypothesis that all the row param- 
eters for any given column are the same, 

Ho: 61/1) = 0/2) = . . . = 60), y'=l,. . .,./ 

against the alternative that one of the rows has param- 
eters consistently higher or lower than the rest. 

To use the rank sum test there must be an estimate 
6j(i) of the row parameter Oj{i) for each cell (ij,). The 
distribution of these estimates must be continuous and 
must satisfy the following conditions. 

a) For each j, the joint distribution of 0j(l), 0/2) . . . 
Oj(I) under H is symmetric with respect to the row 
indexes. 

b) The estimates in one column must be independ- 
ent of the estimates in every other column, i.e., the 
estimates are mutually independent columnwise. 
This is the only between-column restriction. 
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When the above requirements are satisfied, then the 
rank sum test can be used for 77 as follows: Within 
each column compute the estimates 0j(l), . . . , 0/(7) 
of the row parameters and rank the rows accordingly. 
Then sum the ranks for each row. An extreme (large 
or small) value of the rank sum leads to rejection of 7/ . 
The earlier papers, [1] and [2], treated the case Ktj= 1, 
in which the single observation in each cell is an esti- 
mate of the mean or median of the distribution in that 
cell. In the general application of the test, instead of 
ranking the rows (or objects) according to the measure- 
ments, we rank them according to estimates computed 
from the measurements. If (a) and (b) are fulfilled 
then every permutation of the ranks is equally likely 
and the original tables for the rank sum test apply. 
If one of the rows has parameters consistently higher 
(or lower) than the rest, then that row will tend to re- 
ceive high (or low) ranks and hence an extreme rank 
sum. Of course, the efficacy of the test depends on 
the quality of the estimators, Oj(i). 

The conditions (a) and (b) are sufficient for the tables 
in [1, 2], and in this paper to apply. It is interesting 
to note in what situation (a) is fulfilled. 

For instance, (a) is implied by 

(a') For eachy, 0/(1), . . . , 0/7) are mutually inde- 
pendent and identically distributed. 

Thus, consider the common situation where (1) Ky = Kj, 
that is, there is the same number of measurements in 
each cell in the same column, (2) the measurements are 
all independent between cells, and (3) Oj{i) is computed 
only from the measurements in cell {ij) and is com- 
puted in the same way for every cell. Then (a') holds 
and the test can be used. It is not necessary that 
there be the same number of measurements per cell 
from column to column. For example, suppose the 
test is on medians and 6j(i) is the sample median for 
each cell. Then it is permissible to have, say, three 
measurements per cell in the first column, one per cell 
in the second column, four per cell in the third, etc. 

There are other situations where the 0,(0 are not 
computed from the measurements in cell {i, j) only. 
For example, suppose Ky = 1 and 0j(i) is the absolute 
deviation of the measurement in (i, j) from the column 
mean. Then (a') does not hold because the 0j(i)s are 
not independent; however, (a) may still hold and then 
the test can be used. In this example, if the measure- 
ments in the cells are identically and independently 
distributed under 7/ , then (a) is fulfilled because the 
joint distribution of the 6j(i) for each ;, although not 
independent, is still symmetric with respect to the row 
indices. 

Example 1, Test on Means: Consider the usual test 
on the means. If Ky = 1, and xy is the measurement in 
cell (i, j), then 6j(i) = Xy is the estimate of the ith row 
mean for column/ If Ky = Kj > 1, then the cell aver- 
age or the cell median would be used for Oj{i). 

Example 2, Test on Variance: Suppose the measure- 
ments have the same distribution, row to row, except 
possibly for the variances cr §. We wish to test 



Here we need Kij = Kj ^ 2, then we can take 0/0 = 5^ 
the sample within-cell variance. In this case the 
estimates are independent, hence (a') holds, and the 
rank sum test can be applied. A one-sided test might 
be appropriate here. 

An alternative test for equality of variances could be 
based on the within-cell sample ranges, or any other 
dispersion measure. 

Example 3, Test on Accuracy: Suppose Ky = 1 and 
we wish to discover whether any row is substantially 
less accurate than the others. By this is meant that 
its means differ from the other row means, or it has 
larger variances, or any combination of these such that 
its measurements tend to differ from the measure- 
ments of the other rows. 2 

The measurements x y - are assumed to have two para- 
meter distributions with means jMj and variances a j]. 
We test 



7/o- ^ij — ^2j— ■ 



M 



; = l,. • .,7 



(Tij — (T 2 j— • . .=(Ti h 

against the alternative described above. The rank 
sum test can be used by letting 



X -J tZj X 

1 i = 1 



0j(i)=\xij — x.j\ 
ij, and then ranking the rows accord- 



ingly. If some row's measurements deviate con- 
sistently from the column averages, it will receive 
an extreme rank sum. Notice that the statistics 6j(i) 
satisfy condition (a), hence the regular rank sum 
tables apply. A one-sided test is appropriate^ here. 
It is interesting to see just what the statistics 6j(i) do 
estimate. First, it clearly does not matter whether we 
rank by using 0j(i) or 0j(i) so we look at the latter. It 
turns out that 



pW-\f<r%+ JJjmi-im 



+2H- 



where 2 means the sum over V ¥^i. 

v 

Consider the special case where all but one of the 
rows are the same. Let 



and 



M = 


= M3j = 


. . . = (H S 


= W 


a%= 


= °1j = 


■ ■ ■ <>%= 


<*] 




M« = 


= Mj + «j 






°" 2 y= 


-aj+fij 





H :cr?j = crlj = ... = cr?j, for;'=l,. 



../ 



2 This application of Youden's test was first suggested by Robert B. Dean of the Borden 
Chemical Co. In a recent paper [3] T. W. Lashof proposed a "center outward" ranking 
procedure of a similar nature. He suggested that, say, for n odd, the median measure- 
ment be awarded a "rank" of 1, the next larger and the next smaller both a "rank" of 2 
and so on. No tables are available for Lashof s technique. 
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then 



Thus 



and for i # 1, 



E[(X0 - *#] = (^y 1 ) crj + (^) 2 (a) + ft) 



£(*« - *j) 2 = (^y 1 ) <r? + \ 2 {a) + (3j). 



E[e]a)]-E\d*j(2)): 



1-2 



(«) + &) 



Hence, if either the (3j > and they are large, or if 
the afs are large, then 0/(1) will tend to be larger 
than 0/(2), . . . , 0,(7) and the first row will receive an 
extreme rank sum. 



Table 1. — Tables for a one-sided rank sum test at nominal significance levels of 1, 3, and 5 percent 

a = P(r min =£ J + R) = P(r max 5* IJ - R) 



No. of 
objects / 


7 = 3 


7 = 4 


No. of 


0.01 


0.03 


0.05 


0.01 


0.03 


0.05 


judges 
J 


R 


a 


R 


a 


R 


a 


R 


a 


R 


a 


R 


a 


3 

4 
5 

6 

7 
8 
9 
10 

11 
12 
13 
14 
15 





1 

1 
2 
3 

3 

4 

5 

6 


0.0123 

.0041 
.0110 
.0041 
.0084 
.0140 

.0060 
.0094 
.0136 
.0062 
.0088 





1 
1 

2 
3 
4 

4 

6 
6 

7 


0.037 
.012 

.029 
.011 
.021 
.032 
.045 

.021 
.029 
.038 

.018 
.024 



1 

2* 
2 
3 

4* 
5* 

5 

6* 

7* 
7 
8 


0.037 
.074 

.115 

.049 
.072 
.095 
.119 

.059 
.074 
.090 

.047 
.057 


() 


1 

2 
3 
4 
5 

6 
7 
8 
9 
10 


0.0156 
.0039 

.0068 
.0088 
.0101 
.0108 
.0110 

.0110 

.0107 
.0103 
.0098 
.0092 




1 

2 
3 
4 
5 
6 

7 
8 
9 
10 
12 


0.016 
.023 

.027 
.029 
.030 
.029 
.028 

.026 
.025 
.023 

.021 
.039 




1 
2* 

3* 
4* 
5* 
6 

7 

8 

9 
10 
11 
13* 


0.062 
.078 
.082 

.082 
.079 
.074 
.069 
.063 

.058 
.053 
.048 
.043 
.072 


No. of 
objects / 


7 = 5 


1 = 6 


No of 


0.01 


0.03 


0.05 


0.0 1 


0.03 


0.05 


judges 
J 


R 


a 


R 


a 


R 


a 


R 


a 


R 


a 


R 


a 


3 
4 
5 

6 

7 
8 
9 
10 

11 
12 
13 
14 
15 




2 
3 
4 

6 

7 

8 
10 
11 
13 
14 


0.0080 
.0096 

.0090 
.0077 
.0063 
.0126 
.0096 

.0073 
.0117 
.0088 
.0128 
.0096 




1 
2 

3 
4 
6 

7 
8 

10 
11 
13 
14 
16 


0.040 
.040 
.034 

.027 
.021 
.038 
.028 
.021 

.031 
.023 
.032 
.024 
.031 


1* 
2* 
3* 

4 
5 

7* 
8 
9 

11 
12 
14 
15 
17 


0.160 
.120 
.090 

.067 
.050 
.078 
.057 
.042 

.058 
.043 
.056 
.042 
.053 




1 

3 
4 
6 
7 
9 

11 
13 
14 
16 
18 


0.0046 
.0046 

.0108 
.0071 
.0107 
.0068 
.0089 

.0109 
.0127 
.0080 
.0091 
.0100 




1 
3 

4 
6 
7 
9 
11 

13 
14 
16 
18 
20 


0.028 
.023 
.043 

.027 
.037 
.023 
.028 
.032 

.036 
.022 
.024 
.026 

.027 


1* 
2 
4* 

5 

7* 

8 
10 
12 

14 
15 

17 
19 

21 


0.111 
.069 
.097 

.059 
.072 
.045 
.051 

.056 

.060 
.038 
.040 
.042 

.043 


No. of 
objects / 


7 = 7 


7 = 8 


No. of 


0.01 


0.03 


0.05 


0.01 


0.03 


0.05 


judges 
J 


R 


a 


R 


a 


7? 


a 


R 


a 


R 


a 


R 


a 


3 

4 
5 

6 
7 
8 
9 
10 

11 
12 
13 
14 
15 


1 
2 

4 
5 

7 
9 
11 

13 
15 

17 
20 

22 


0.0146 
.0087 

.0125 
.0067 
.0078 
.0083 
.0085 

.0084 
.0080 
.0076 
.0115 
.0105 



2 
3 

5 
7 
9 
11 
13 

15 
18 
20 
22 
24 


0.020 
.044 
.023 

.028 
.029 
.029 
.028 
.026 

.024 
.036 
.032 
.028 
.025 


1* 
3* 
4 

6 

8 
10 
12 
14 

16 
19 
21 
23 
26 


0.082 
.102 

.052 

.055 
.054 
.052 
.048 
.044 

.040 
.055 
.049 
.043 
.055 




1 
3 

4 
7 
9 
11 
13 

16 
18 
21 
23 
26 


0.0156 
.0098 
.0137 

.0064 
.0131 
.0116 
.0099 
.0083 

.0114 
.0092 
.0115 
.0092 
.0110 



2 
4 

6 
8 
11 
13 
16 

18 
21 
23 
26 
29 


0.016 
.029 
.031 

.028 
.024 
.035 
.029 

.036 

.029 
.034 
.027 
.030 
.034 


1 
3 

7 
9 
12 
14 
17 

19 
22 
25 
27 
30 


0.062 
.068 

.061 

.052 
.043 
.058 
.046 
.056 

.044 
.050 
.056 
.044 
.048 



No. of 

objects 7 


7 = 9 






7 


= 10 








0.01 


0.03 




0.05 




0.01 




3.03 




3.05 


No. of 
























judges 


























J 


R 


a 


R 


a 


R 


a 


R 


a 


R 


a 


R 


a 


3 





0.0123 





0.012 


1 


0.049 





0.0100 


1 


0.040 


2* 


0.100 


4 


1 


.0069 


2 


.021 


3 


.048 


2 


.0150 


3 


.035 


4* 


.070 


5 


3 


.0085 


5 


.038 


6* 


.070 


4 


.0126 


5 


.025 


6 


.046 


6 


5 


.0078 


7 


.029 


8 


.051 


6 


.0092 


8 


.030 


9 


.050 


7 


8 


.0121 


10 


.036 


11 


.059 


9 


.0114 


11 


.032 


12 


.050 


8 


10 


.0091 


12 


.026 


13 


.042 


11 


.0076 


14 


.032 


15 


.048 


9 


13 


.0114 


15 


.029 


16 


.045 


14 


.0081 


17 


.030 


18 


.044 


10 


15 


.0082 


18 


.03 1 


19 


.047 


17 


.0082 


20 


.028 


22 


.058 


II 


18 


.0094 


21 


.033 


22 


.047 


20 


.0081 


23 


.026 


25 


.051 


12 


21 


.0103 


24 


.033 


25 


.047 


24 


.0114 


27 


.033 


28 


.045 


13 


24 


.0109 


27 


.033 


28 


.046 


27 


.0105 


30 


.029 


32 


.054 


14 


27 


.0113 


30 


.033 


31 


.045 


30 


.0096 


33 


.026 


35 


.047 


15 


30 


.0115 


33 


.032 


34 


.044 


33 


.0087 


37 


.031 


39 


.054 


No. of 
objects / 


/ = 11 






I 


= 12 








0.01 


0.03 




0.05 




0.01 




0.03 




J.05 


No. of 
























judges 


























J 


R 


a 


R 


a 


R 


a 


R 


otv 


R 


a v 


R 


a v 


3 





0.0083 


1 


0.033 


2* 


0.082 





0.007 


1 


0.028 


2 


0.069 


4 


2 


.0113 


3 


.026 


4 


.052 


2 


.009 


3 


.020 


4 


.040 


5 


4 


.0086 


6 


.032 


7 


.054 


5 


.012 


6 


.022 


8 


.062 


6 


7 


.0107 


9 


.031 


10 


.049 


8 


.012 


10 


.032 


11 


.049 


7 


10 


.0110 


12 


.028 


13 


.043 


11 


.011 


13 


.026 


15 


.057 


8 


13 


.0104 


15 


.025 


17 


.054 


14 


.009 


17 


.030 


18 


.043 


9 


16 


.0094 


19 


.031 


20 


.044 


18 


.011 


21 


.032 


22 


.045 


10 


19 


.0083 


22 


.026 


24 


.050 


21 


.008 


25 


.034 


26 


.045 


11 


23 


.0105 


26 


.030 


28 


.055 


25 


.009 


29 


.033 


30 


.045 


12 


26 


.0088 


30 


.033 


31 


.044 


29 


.010 


33 


.033 


35 


.057 


13 


30 


.0102 


33 


.026 


35 


.047 


33 


.010 


37 


.032 


39 


.054 


14 


34 


.0115 


37 


.028 


39 


.048 


37 


.010 


41 


.030 


43 


.051 


15 


37 


.0093 


41 


.030 


43 


.050 


41 


.010 


45 


.029 


47 


.047 


No. of 
objects / 


7=13 






7 


= 14 








0.01 


0.03 




0.05 




0.01 


( 


J.03 


0.05 


No. of 
























judges 


























J 


R 


«(/ 


R 


OCV 


R 


ctu 


R 


ai; 


R 


otv 


R 


a v 


3 





0.006 


1 


0.023 


2 


0.059 





0.005 


1 


0.020 


2 


0.051 


4 


2 


.007 


4 


.032 


5 


.057 


3 


.013 


4 


.025 


5 


.046 


5 


5 


.009 


7 


.028 


8 


.045 


6 


.012 


8 


.033 


9 


.052 


6 


8 


.008 


11 


.033 


12 


.050 


9 


.009 


12 


.034 


13 


.050 


7 


12 


.010 


15 


.035 


16 


.050 


13 


.010 


10 


.032 


17 


.046 


8 


16 


.011 


19 


.035 


20 


.048 


17 


.010 


20 


.029 


22 


.054 


9 


19 


.008 


23 


.033 


24 


.045 


21 


.009 


25 


.034 


26 


.046 


10 


23 


.008 


27 


.031 


29 


.055 


25 


.008 


29 


.029 


31 


.050 


11 


28 


.011 


31 


.028 


33 


.049 


30 


.010 


34 


.032 


36 


.053 


12 


32 


.011 


36 


.033 


38 


.055 


34 


.009 


39 


.033 


41 


.054 


13 


36 


.010 


40 


.029 


42 


.048 


39 


.010 


43 


.027 


46 


.055 


14 


40 


.009 


45 


.033 


47 


.052 


44 


.011 


48 


.028 


51 


.054 


15 


45 


.010 


49 


.029 


51 


.045 


48 


.009 


53 


.028 


55 


.044 



See footnote at end of table 
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Table 1. — Tables for a one-sided rank sum test at nominal 
significance levels of 1, 3, and 5 percent — Continued 

oc = P(r min ^ J + R) = P(r max 3= IJ - R) 



No. of 










objects / 






7=15 








0.01 


0.03 


0.05 


No. of 










judges 














J 


R 


«t/ 


R 


OLV 


R 


av 


3 





0.004 


1 


0.018 


2 


0.044 


4 


3 


.010 


5 


.037 


6 


.062 


5 


6 


.009 


8 


.025 


10 


.059 


6 


10 


.010 


12 


.024 


14 


.051 


7 


14 


.010 


17 


.030 


19 


.057 


8 


L8 


.009 


22 


.034 


23 


.045 


9 


23 


.011 


26 


.027 


28 


.047 


10 


27 


.009 


31 


.028 


33 


.046 


11 


32 


.009 


36 


.027 


38 


.045 


12 


37 


.010 


41 


.027 


44 


.053 


13 


42 


.010 


47 


.032 


49 


.050 


14 


47 


.010 


52 


.030 


54 


.046 


15 


52 


.009 


57 


.028 


59 


.043 



i order to avoid duplication in the tables these values of R do not give as as close as 
"jle to the nominal significance levels listed. They are already given in the column 
immediately adjacent, hence the tabulated R gives another still higher (or lower) signifi- 
cance level. 



2. Tables for a One-Sided Test 

In both the ordinary application of the rank sum test 
for outliers and in some of the examples given in sec. 1, 
one-sided tests may be appropriate. Table 1 gives 
approximate 0.01, 0.03, and 0.05 one-sided probability 
points for the extreme rank sum. It is tabulated in 
much the same way as the table of two-sided proba- 
bility points given in [2]. 

The table can be described as follows: Let / be the 
number of objects ranked and ,/ be the number of 
judges. Then the smallest that a rank sum could be 
is J and the largest it could be is IJ. Let r> be the 
rank sum of the ith object, and let 



^max max n, 
ississy 

r mm =minn 

Let R be an integer and a be a probability such that 
a = P(r min «./ + /?) = P(W 3* IJ-R) 

under the null hypothesis that all rankings are equally 
likely. 

Table 1 gives, for 3 ^ / ^ 15, 3 ^ ,/ ^ 15, the values 
of R yielding significance levels, a, as close as possible 
to the nominal significance levels of 0.01, 0.03, 0.05. 
In small print next to each R is given the corresponding 
value of a. 

For example, suppose 7 = 8 and J = 6. Then all the 
rank sums must be between 6 and 48. From table 1 
we see that 7? = 4 yields a = 0.0064. Thus, a one- 
sided test for large rank sums at a significance level 



0.0064 can be made by rejecting the hypothesis when 
r max ^ 48 — 4 = 44. That is, if any rank sum is 44 or 
more, it is rejected as too large. Similarly, the 
corresponding test for small rank sums would be to 
reject whenever r min ^ 6 + 4 = 10. 

From the same line of the table we see that a critical 
region of r max ^ 42 has a significance level of a = 0.028, 
and a critical region of r max 5= 41 has a = 0.052. Be- 
cause of the discrete nature of the rank sum statistic, 
a = 0.0064, 0.028, and 0.052 are the closest significance 
levels possible to 0.01, 0.03, and 0.05, respectively. 

Table 1 can be thought of as an abbreviated table of 
the distribution function of the largest (or smallest) 
rank sum. In several places the values of R yielding 
as closest to 0.03 and to 0.05 are the same. To avoid 
duplication and to offer a wider choice of significance 
levels in the table, the value of R belonging to both 0.03 
and 0.05 is given in the 0.03 column and the next higher 
value of R is given in the 0.05 column even though it 
doesn't "belong" there. The same procedure was 
followed whenever possible and when there was a 
duplication in the 0.01 and the 0.03 column. These 
places in the table are marked with an "*". 

3. Computation of the Table 

The significance level a for any given R cannot be 
computed easily, but bounds, otu and a L , such that 
a L ^ a ^ au can be. Using eqs (2), (3), and (6) of [2] 
au and a^ were computed for / ^ 11. For the 0.01 
(0.03) level, au and ai always agree to four (three) 
decimal places, hence the values in the table for a 
are exact to the four (three) decimal places given. 

For the 0.05 level av and a^ did not always agree 
when rounded to three places although 

OLu-a L < 0.0005 

all the time. The rounded value for a L was chosen 
since a L is a better approximation to a. 

For I ^ 12, ai was not computed, hence au, not a, 
is given in the table. From the computations per- 
formed for [2] for large I it can safely be assumed that 
au agrees with a to 3 decimal places in the 0.01 and 
0.03 column and that the a^'s given in the 0.05 column 
are in error by at most 0.002. Hence a v can be used 
as a good approximation to a. 
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